Introduction to Linear Algebra: The Language of Vectors: Scalars and Combinations

Linear Algebra is the study of two fundamental actions: adding vectors ($v + w$) and scaling them by numbers ($cv$). When we synthesize these actions, we arrive at the Linear Combination, the essential grammar of the subject. Rather than viewing data as isolated lists, we treat them as single entities—column vectors—that can be stretched, flipped, and combined to span new dimensions.

The Foundations: Components and Columns

A vector $v = \begin{bmatrix} v_1 \\ v_2 \end{bmatrix}$ is defined by its components; $v_1$ is the first component (often horizontal displacement) and $v_2$ is the second (vertical). This vertical orientation is not just aesthetic; it is the prerequisite for the matrix-vector multiplication that defines modern computing.

The Scalar $c$

A scalar is simply a number. When you compute $2v$, you multiply every component: $2 \begin{bmatrix} v_1 \\ v_2 \end{bmatrix} = \begin{bmatrix} 2v_1 \\ 2v_2 \end{bmatrix}$. Negative scalars, like $-1$, reverse the vector's direction.

Vector Addition

Adding vectors happens component-wise: $v + w = \begin{bmatrix} v_1 + w_1 \\ v_2 + w_2 \end{bmatrix}$. Geometrically, this follows the "tip-to-tail" rule, where following one vector after another leads to the sum.

The Linear Combination: $cv + dw$

This is the most important construction in linear algebra. It represents the ability to reach any point in space by scaling and summing our basis vectors. For example:

$$c \begin{bmatrix} 1 \\ 1 \end{bmatrix} + d \begin{bmatrix} 2 \\ 3 \end{bmatrix} = \begin{bmatrix} c + 2d \\ c + 3d \end{bmatrix}$$

If we set $c=1$ and $d=1$, we get the sum $v + w = \begin{bmatrix} 3 \\ 4 \end{bmatrix}$. If we set $c=0$ and $d=0$, we reach the Zero Vector: $\mathbf{0} = \begin{bmatrix} 0 \\ 0 \end{bmatrix}$. Note that the vector $\mathbf{0}$ is distinct from the scalar $0$; it is the origin of our coordinate system.

🎯 The Robot Analogy

Imagine a robot on a grid. Vector $v = [1, 1]^T$ is a command to move 1 unit North and 1 unit East. Vector $w = [2, 3]^T$ is a command to move 2 units North and 3 units East. Any location the robot can reach is a linear combination of these two commands.